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ABSTRACT 

This symposium was intended to promote discussion of 
policies, procedures, and activities to enhance collaboration among 
programs of the Office of Educational Research and Improvement (OERI) 
in ways that would contribute to more efficient and effective 
management of the nation's overall educational research, development, 
and dissemination (RD&D) system. The topics addressed were concerned 
with: (1) the increase in the importance of educational research; (2) 
the structure of the RD&D system; (3) the nature of collaboration; 
and (4) OERI's role in fostering collaboration. The report provides 
an executive summary of the session as well as the comments of the 
two speakers who introduced and moderated the symposium and the three 
members of the symposium panel: (l) Judi Conrad, ERIC Clearinghouse 
on Handicapped and Gifted Children; (2) Bruno Manno, OERI; (3) John 
Hollifield, Dissemination and Outreach Center for Research on 
Elementary and Middle Schools, Johns Hopkins University; (4) David 
Crandall, Laboratory for Educational Improvement of the Northeast and 
Islands; and (5) Susan Fuhrman, Center for Policy Research in 
Education, Rutgers University. Also provided are the comments of two 
reactors, Christopher Cross of Macro Systems, Inc., and Willis Hawley 
of Vanderbilt University, and the senior officials -of the five OERI 
program offices: Milton Goldberg, Office of Research; Nelson Smith, 
Programs for the Improvement of Practice; Emerson Elliot, National 
Center for Education Statistics; Ray Fry, Library Programs; and 
Sharon Horn, Information Services. Bruno Manno delivered the closing 
remarks. (SD) 
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The Role of OERI and 

Its Institutional Projects in Establishing an 

Effective Research, Development, and Dissemination Program 



Introduction 

The Office of Educational Research and Improvement 
(OERI), in conjunction with the annual meeting of the ERIC 
Directors, held a symposium designed to promote discus- 
sions on the effectiveness of the existing structure of the 
nauon's educational ruse arch, development, nnd dissemina- 
tion (RD&D) system. symposium, whicn continued ef- 
forts begun last year to foster collaboration among and 
between OERI and its institutional projects, had as its 
specific purpose a discussion of policies, procedures, and 
acii viues to enhance collab ^ration among OERI 's programs 
in ways ihal would contriLutc to more efficient and effec- 
tive management of the overall RD&D enterprise. 

In the late 1960s, as part of an expanded effort to build a 
more scientific base of knowledge for the practice of educa- 
tion, the Bureau oi Kesearch initiated a network of nation- 
al! research centers, regional education laboratories, and 
information clearinghouses. Smce that time, considerable 
changes have taken place in the practice, delivery, and struc- 
ture of education. More significant changes have taken 
place with respect to the role of State agencies and the 
dci^ands for information about education from a vide 
spcctnim of public officials and lay groups. 

Presenters at this symposium were chosen on the t isis 
of iheir expcnence and knowledge of the Federal efforts in 
the support of education RD&D over the past two decades 
and their ability to recognize a new set of demands which 
could influence the current arrangement and operation of 
those institutions which cn^ate, an^Jyze, or disseminate re* 
scar h and statistical information relating to education. The 
stimulating and thoughtful n^marks of the presenters and the 
discussions to follow should contribute to the planhing and 
policy development of the Administration and the Congress 
as they consider appropriate options for a .new and more ef* 
fective infrastructure for Federal education RD&D. 

Judi Conrad, Associate Director, LRIC Clearinghouse on 
Handicapped Children, Council for Exceptional Children, 
introduced the symposium. OERI Acting Assistant 
Seaetary Bruno Manno served as symposium moderator. 



Executive Summary 

The panel consisted of three presenters: John Hollifield, As- 
sociate Director for Dissemination and Outreach , Center for 
Research on Elementary and Middle Schools, Johns Hop- 
kins University; David Crandall, Director, Laboratory for 
Educational Improvement of the Northeast and Islands, The 
Network, Andover, Massachusetts; and Susan Fuhrman, 
Director, Center for Policy Research in Education, Eagleton 
Institute of Politics, Rutgers University; and two reactors, 
Christopher Cross, Vice Chairman, Macro Systems, Inc., 
Silver Spring, Maryland, and Willi: Hawley, Dean, 
Pcabody College, Vanderbill University. These presenta- 
tions were followed by comments from senior officials of 
'he five OERI program offices: Millon Goldberg, Director, 
Office of Research; Nelson Smith, Acting Director, 
Programs for the Improvement of Practice; Emerson Elliott, 
Acting Commissioner, National Center for Education 
Statistics; Ray Fry, Senior Advisor, Library Programs; and 
Sharon Horn, Acting Director, Information Services. 

This paper summarizes the remarks of the presenters and 
reactors around the following topics: 1) the increase in the 
importance of educational research; 2) the structure of the 
RD&D system; 3) the nature of collaboration; and 4) 
OERI's role in fostering collaboration. 

Increase in Importance of 
Educational Research 

In his opening remarks. Acting Assistant Secretary 
Manno noted a recent trend — the growth in the importance! 
of educational research, especially among noneducation 
groups. He observed that the debate about education in this 
coui.try has begun to include "our topic," educational re- 
search, development, and dissemination, with members of 
the business community, press, and policymakers calling for 
a stronger federal RD&D effort This increased importance 
of education RD&D, according to Manno, seems to be 
prompted by the need of educators, policymakers, parents, 
and cuizens brbcuer performance from schools. The latest 
infonnation on state*of-ihe-art policies and practices is per* 
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ccived as critical lo guiding change and sorting out which 
changes deliver real improvements in student learning. As 
Manno stated, "If there is any one role that the Federal 
Government has when it comes to education, it is the 
provision of accurate, timely, and reliable information on 
education/ 

Structure of the RD&D System 

According to Manno, making the most of its limited 
federal dollars is one of the most important challenges 
facing OERI. Meeting this challenge, he said, "depends 
largely upon how much progress we continue to make 
'ov/ard a longstanding OERI goal, which is making OERI 
less an array of discrete, independently operating units and 
more of a unified, coherent organization, a coordinated, in* 
icgrated RD&D system'' 

HoUifield echoed Manno*s call for an integrated RD&D 
system, stressing the need for all the elements— OERI, the 
research centers, regional labs, ERIC, and the NDN — to 
work in conjunction with one another and with national 
education associations, individual researchers, and multiple 
special interest groups, all pulling together to improve the 
bottom line, student learning. He supported the current 
structure but suggested some modifications in parts of the 
system. He said that R&D centers should conduct basic re- 
search but that the nature of the R&D should be determined 
by their mission areas. Thus some centers would be devoted 
exclusively to basic research, whereas others would be "full 
service" centers, more heavily into development, im- 
. picmeniation, and evaluation. The regional labs should not 
only continue to respond to the needs of their regions with 
R&D information but should also develop and maintain the 
capacity to conduct research projects. This model suggests 
that neither centers nor labs will look alike but rather will 
function in ways that best serve their clients. Hollifteld 
urged that both centers and labs engage more in R&D that 
produces proven effective programs and practices for use 
by schools and districts and channel their research-based 
school improvement products into the NDN, which offers 
"a precise model for dissemination and use of research- 
based R&D . . . with some evidence that it works in terms 
of improving student achievement/ 

Regarding ERIC, he identified the need to **let ERIC be 
ERIC/ concentrating on its mission of information acquisi- 
tion and dissemination undiluted by additional tasks. For ex- 
ample, according to Hollifield, the ERIC system should not 
be held responsible for the proper and effective use of its in* 
formation. Rather, he proposed a separate effort funded 
specifically to document the impact of dissemination of re- 
search findings through ERIC, the labs and centers on stu* 
dent learning. For Hollifield, "such evidence, when 
gathered, will strengthen the entire R&D enterprise/ 

Crandall, representing a lab, the NDN, and a minicenter, 
noted that the elements of the current system — the clearing- 
houses* regional labs, and the state facilitors of the NDN— 



have stood the test of time and urged that they become "per- 
manent parts of the infrasuiicture'* as a means of stabilizing 
the RD&D system. 

Hawley also called for changes, raising the possibility of 
a rcconceptualizalion and radical restrxicturing of the entire 
R&D system sometime in the future. He observed that im* 
portant pieces are missing in the current system, such as a 
mechanism for knowledge utilization to feed back to x* 
search. Relatively few people, especially at the school level, 
are required to utilize research. As a solution, he proposed 
an enhanced role for school librarians, to provide informa* 
tion to help teachers and school administrators. This would 
necessitate a rethinking of library training at the Federal 
level. 

In addition, Hawley pointed out the need to accom- 
modate the new role and capacity of the States, which has 
major implications for the restructuring of the labs and 
ERIC. He suggested that a realignment of the ERIC system . 
by clustering or consolidating the existing centers or align- 
ing ERIC with the research priorities evident in the missions 
of the centers themselves, would be desirable. 

Cross advocated that the system specifically recognize 
the multiple viewpoints of the consumers. He urged that the 
Dcparuncnt convene a group of education information con- 
sumers, a "focus group,'' in order to understand what infor- 
mation they need, how they go about trying to gel it, and the 
barriers to geuing information that exist in the current sys- 
tem. He also proposed that the Federal Government look at 
the whole enterprise of RD&D and ask the question: "What 
needs to be done now?" He pointed out that when the educa- 
tional R&D institutions were created in the mid-1960s, 
nothing else existed; now there is a variety of other infor- 
mation providers and users in the system. Cross called for 
{something like ajNational|Academy|of jScienccs/National 
Research Council panel to look at this enterprise and report 
to the Department, and to the Federal Government as a 
whol<*, with recommendations for reorganizing the RD&D 
system. 

Nature of Collaboration 

Whether suggesting major changes or minor modifica- 
tions in the current structure of the RD&D systen*, all 
speakers supported increased collaboration as a means of 
increasing the effectiveness of the system. To achieve 
OERPs goal of a coordinated, integrated RD&D system, 
Manno urged continuation of efforts in three areas: com- 
munication, cooperation, and collaboration. He urged more 
of the "three Cs" in a variety of efforts — topical or thematic 
approaches, general functions such as knowledge genera- 
tion and dissemination, and a range of specific activities, 
citing early childhood as one area ripe for collaboration. 
Crandall added a fourth X," coordination, stressing the 
need to understand the differences among each of the levels 
and the interrelationships. 
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The panelists warned against collaboraiion for its own 
sake, but rather» as Fuhrman stated, to keep focused on '*coI* 
laboralion for the sake of improving the efnciency, the 
quality, the impact of educational research and develop- 
ment" The views of the panelisL^ varied regarding the cir- 
cumstances promoting collaboration. Collaboration, said 
Crandall, "is not a natural act," but for people willing to en- 
dure some pain, "it is worth it;" to occur, it needs some *' forc- 
ing" and facilitating from OERI, But from Fuhrman's point 
of view, collaboration occurs "naturally" when people know 
each other, perceive common interests and muuial benefit. 
Such collaboration neither needs nor requires incentives 
from OERI to occur. She urged against fund setasides or 
special competitions and against rewarding or encouraging 
collaboration in and of itself, as such might divert the focus 
away from collaboration undertaken in the service of im- 
provement 

The notions of common interest and mutual benefit as 
bases for collaboration were underscored by Hawley. Com- 
mon interest relates to agreement on the bouom line. Per- 
ception of mutual benefit relates to a shared common 
concern about outcomes and perception of mission — and 
the norm of reciprocity, the perception of equal conuibu- 
lions to a collaborative activity. Hawley urged considera- 
tion of ways to create intcrdcpcndcncics between research 
and dissemination that lead to equal status. He added four 
additional bases for collaboration: self-interest, trust, the 
need for a common language, and common consuucLs. 

OERrsRofe in 
Fostering Collaboration 

Several of the speakers presented their views of OERKs 
role regarding collaboraiion. To encourage collaboration 
among the institutional projecis, Fuhrman suggested that 
OERI: 1) provide occasions for those involved in the institu- 
tional projects to meet and to forge working relationships; 
2) increase and enhance information-sharing avtivities; 3) 
renoove barriers to sharing data and work in progress; and 



4) establish routine mechanisms for institutional projects to 
help each other in dissemination activities. To facilitate col- 
laboration between OERI-funded projects and the Held, she 
encouraged OERI to work with associations-*both 
policymaker and practitioner associations — to encourage 
links with clients and clients' groups in missiot. statements 
and in continuin/^ liaison work and to provide opponunities 
for client groupf. to meet and hear center researchers — basi- 
cally facilitating the kind of interaction which gets the re- 
search to the clients. Fuhrman also encouraged OERI to 
collaborate with other government agencies. 

Crandall encouraged organizational incentives "for the 
kind of exchange that goes beyond simply licking the stamp 
and sticking it on your latest report and firing it out in the 
mail," He viewed OERI's role as that of facilitator, "com- 
bining the forcing function with the friendly cupport in 
facilitation." He urged OERI to "require us to sit down and 
knock our heads together on some stuff ... in ways that 
haven't been uied yeL" At the same time he suesscd, We 
need time to get our own acts together, whether it be in net- 
works, or subnetworks of like-minded people, or umbrella 
organizations." 

Conclusion 

In responding to the symposium topic, panelists 
presented their v^ews regarding 1) the rcsirucluring of 
OERI's current RD&D system, 2) the role of collaboration 
in contributing to an integrated RD&D effort, 3) the ways 
in which collaboration can be enhanced between and among 
OERI and the institutional projects, and 4) OERI's role in 
fostering collaboration. 

In his closing remarks, Manno emphasized the special 
and unique "window of opportunity" which now exists in 
reference to OERl's RD&D efforts, offering an unprece- 
dented opportunity to multiply the impact of research on 
practice. The ideas and interactions generated by the sym- 
posium will conuibute to this effort. 
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I am very pleased and proud lo welcome all ihc speakers, 
the reactors, and ihc CERI sLafrwho have gathered together 
loday to attend this symposium. The ERIC system is very 
concerned about the Toe us and the role that it is to play in 
the integration of insiitutional projects. We heard some 
remarks a few moments ago about the significance of what 
wc arc all about educating children; delivery of informa- 
tion that makes for effective education in this countr>'. We 
are all a part of that enterprise. 

This meeting is structured lo examine the various roles 
that we can play to make that happen. The mechanism that 
we are looking at today is collaboration. I am here to tell 
you that I know collaboration works. I know, because the 
ERiC system has entered into what we are calling ERIC 
partnerships that are tremendously dynamic, tremendously 
powerful in the identification of the resources that all our 
constituents have to bring to bear on the delivery of infor- 
mation. We are finding out whai we can offer our partners, 
what they can offer us, whiat formats most please those folks, 
what kinds of information they need, what topics are of most 
concern to them. We know collaboration works. 

Wc need now to woik together, those of us who are in- 
stitutional projects within OERI, to promote that same kind 
of interaction, that same kind of maximizing of resources to 
better deliver information to those who are the practitioners 
in this country, to those who are on the front line delivering 
education to children. 

Bruno Manno, who is the Acting Assistant Secrciary for 
OERI» will serve as the moderator for this meeting. 



Acting Assistant Secretary 

Orrice of Educational Research and Improvement 

U.S. Department of Education 

Let me begin my remarks by making two points and dis- 
cussing these points in more detail. I would like to discuss 
a trend that I have seen emerging over the last couple of 
years in education research. From my perspective, the im- 
portance of education research, and in particular its per- 
ceived importance by noncducation groups, has grown 
immensely in recent years. That is point number one. I will 
elaborate on that in a second. Point number two is this: This 
trend, coupled with upcoming events in OERI, offersan un- 
preccdenicd opportunity for this agency to multiply the im- 
pact of research on practice. 

Let's go back to the first point The debate about educa- 
tion in this country in rjie last few years has begun to include 
what I want lo call "our topic," education research, develop- 
ment, and dissemination, or RD&D for short What I think 
is significant about this is that the perceived need or demand 
for more RD&D "leaked out" of the education community. 
An interesting collection of leaders and groups is calling for 
a stronger Federal RD&D effort. 

Let me give you some examples of those groups. David 
Keams, in his book Winning the Brain Race, sets forth an 
education recovery plan that includes more research, more 
experiments in teaching and school organization, and a 
bccfed-up national assessment of educational progress 
(NAEP). 

Another example: In the 1989 report. Governing 
America, published by the Council on Competitiveness, we 
see ihe Council calling for "additional (Federal) technical 
support for innovative school-reform programs." That 
report specifically names OERI and emphasizes the impor- 
tance of OERI's mission, which the Council says, is to "col- 
lect and analyze information about State and local*based 
educational programs, identify best educational practices, 
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and provide interested State and local educational 
authorities with inrormation on ihe development, organiza- 
tion and operation of such programs. That is another ex* 
ample oran outside group, a noneducation group in the strict 
sense of the word, uilking about this RD&D mission. 

Here is another example. The Business Higher Educa* 
Uon Forum recently issued a report entitled American 
Potential: The Human Dimension, which states that more 
knowledge is needed '^of cognitive processes and effective 
teaching and learning strategies" and that a better job must 
be done in '^getung this information to the classroom 
teacher" 

The importance of improving RD&D is implicit in a 
number of reports, including one that President Bush has 
embraced, the National Center on Education and the 
Economy's To Secure Our Future: The Federal Role in 
Education. 



Business and CEOs are not the only ones 
calling for more and better education 
RD&D. Educators^ the press, and 
policymakers have chimed in. 



Business and CEOs are n oi the only ones calling for more 
and better education RD&D. Educators, ihe press, and 
policymakers have chimed in. Pat Graham, Dean of 
Harvard's School of Education, in a A^ew York Times article 
is quoted by Ed Fiske as saying, "If we arc serious about 
■ changes like dccenu-alizing school management, then we 
need to invest more significantly in fmding out how to do 
it" Ed Fiske, in another article, had this to say: If the educa- 
tion system is to be altered in the fundamental ways Presi- 
dent Bush seems to desire, "a more vigorous Federal 
research role might pay big dividends." Joan Wills, former- 
ly of the NGA and now with the National Center on Educa- 
tion and the Economy, in an appearance before the 
Subcommittee on Education and Health of the Joint 
EcononTiic Committee, pleaded for a sponger Federal effort 
in data collection, and in assessing student achievement. 

I could go on and refer to other groups which have called 
for this increased RD&D role from the Federal perspective, 
but my point has been made: the p^xeived importance of 
education RD&D has grown in recent years. The reason as 
I see it is this: educators, policymakers, parents, and citizens 
want beuer performance from their schools. Good informa- 
tion — the latest up-to-date information on state-of-the-an 
policies and practices — is rightly perceived as critical to 
guiding and directing changes and to sorting out which 
changes deliver real improvements in student learning. 

Providing such information is not the only Federal 
responsibility in education, but it is certainly the oldest and 
in many ways the most central Federal role in education. In 
fact, the Subcommittee on Select Education, which is the 
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oversight committee for OERl. wrote last September that 
"of all the forms of assistance that the Federal Government 
could possibly provide, RD&D is the least expensive, the 
least threatening, and the most needed." 

My second point, Tiiis is the notion of the upcoming 
events in OERI that create a window of opportunity. As you 
know, OERI is the main conduit for federally supported 
education RD&D. But like all Federal agencies, as much as 
we continue to plead with the Congress for more money to 
support RD&D efforts, we live in the shadow of Gramm- 
Rudman. So we must make the most of the limited Federal 
dollars that we have. 

From my perspective, this is one of the most important 
challenges that OERI has to face in the coming years. Our 
ability to meet it depends largely upon how much progress 
wc continue to make toward a longstanding OERI goal, 
which is making OERI less an array of discrete, inde- 
pendently operating units and more of a unified, coherent 
organization, a coordinated, integrated RD&D system. 

To achieve that. OERI and its institutional projects must 
continue to increase our efforts in three areas: communica- 
tion, cooperation, and collaboration. You might call this 
OERI's version of the three Cs. We all stand to benefit from 
more communication, cooperation and collaboration. I 
think we all recognize that. This year, as indicated in 
Elizabeth Payer's background paper, which I think most of 
you received, Elizabeth says that more than 158 different 
organizations are receiving a share of OERI's RD&D 
budget, to the tunc of about 555 million. 

The mission and goals of these various organizations 
carry them into territories that often overlap. Let's look at 
early childhood, for example. In Information Services in 
OERI we have a clearinf^.house ihat collects and dissemi- 
nates infomiation on early childhood education. In the Of- 
fice of Research, we have a new Center for Research on the 
Education of Disadvantaged Students. Intervention in pre- 
school years is critical to any comprehensive effort to help 
disadvantaged students, and to there ought to be informa- 
tion and ideas fiowing between staff at the clearinghouses 
and staff at the Center. 



[We] must continue to increase our efforts 
in three areas: communication, coopera- 
tion, and collaboration. You might call this 
OERVs version of the three Cs. 



There are a number of other early childhood projects 
planned or under way in OERI. For instance, through our 
Fund for Innovation in Education, formeriy known as the 
Secretary's Discretionary Fund in the FIRST program, wc 
arc planning a competition for projects in early childhood 
education. 



This summer. Programs for ihc Improvement of Practice 
(PIP) will host a miniconfcrcncc lo gather advice from ex- 
perts, advice thai will help guide an upcoming RFP for early 
childhood drug prevention curriculum materials. PIP's 
Urban Superintendents Network is assembling a report on 
the role of public schools in early childhood intervention. 
Six of the nine regional labs, according to the infomiauon I 
have, have been involved in an early childhood project of 
some kind since 1986. Also in PIP, the NDN has about 30 
projects aimed at children under five. The issue after the 
next publication ofYouth Indicators, about a year from now, 
will include data on children under five for the first time. 
That is a joint publication of PIP and NCES. Library 
Programs supports a number of literacy projects aimed at 
preschool children. There are other early childhood-related 
activities going on in OERI. 

My point is to begin to invite people to think about the 
three Cs with reference to a variety of things that we are 
doing. The three Cs should not be limited to just topical or 
thematic approaches either. That is the kind of approach that 
I have highlighted in talking about early childhood educa- 
tion. Elizabeth points out that one can begin to talk about 
groupings around general functions such as "knowledge 
generation" or "knowledge dissemination," around specific 
activities, around a host of other sons of approaches that are 
also possible. We probably all agree that with rrTerence to 
the three Cs there ought to be more of it. Right now we have 
a special and unique window of opportunity, especially as 
OERI approaches the recompetiiion of the labs and the 
centers. 

I have uicd to lay out for you quickly what I see as an 
emerging trend, a uend that coincides with a topic that is on 
your mind. I have uied to quickly give you an example of a 
topic area that OERI has been working on for some time and 
has a variety of activities blossoming. And I have tried to 
suggest that perhaps as these two things begin to inicrsecu 
we need lo ihink a little bit more how the so-called three Cs 
relate to both of these issues. 

John Hollif leld 



Associate Director for Dissemination and Outreach 
Center for Research on Elementary and Middle Schools 
Johns Hopkins University 

I am the Associate Director of the Center for Research 
on Elementary and Middle Schools, basically the Associate 
Director for the new Center on Research on the Disad- 
vantaged We have two centers at Johns Hopkins. I have 
been in the Center for 19 years now. I disseminate informa- 
tion and research products. That is my responsibility. After 
19 years I am still enthusiastic and still disseminating^ 

For over 19 years we have collaborated extensively with 
ERIC, other centers, regional labs, NDN, OERI, and with 
NAESP, ASCD. NEA, NASSP— you can make up a ran- 
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dom acronym and wc have probably worked with iL I have 
a three-page list of our collaborative activities with OERI, 
NDN, and so on. I am not going to talk about that Anyone 
who wants a copy can have it I think it could serve as a 
model for some of the kinds of collaborative aciiviiics that 
can take place. What I really want to do is talk a bit about 
the R&D system and my view after 19 years in it of how 
things might be integrated. 

The elements include OERI, R&D centers, regional labs, 
ERIC clearinghouses, and the NDN. But these all have to 
work in conjunction with one another and in conjunction 
with national education associations, individual re- 
searchers, multiple special interest groups, and all of this 
should be pulling together to improve American education. 

To elatx)rate a little, OERI should fund institutional re- 
search, development, and dissemination but must have the 
latitude to externally fund special interest projects, conduct 
in-house special interest projects, fund field-initiated re- 
search by individual researchers, and if the system is to be a 
system, somebody must coordinate, and OERI is the natural 
selection for that. R&D centers should conduct basic re- 
search and development, but their mission areas should 
determine the nature of that R&D. Some centers, depcnd- 
i ng on the m iss ion area, sh ould be devoted almost excl usi ve- 
ly to basic research. 

Others, working from a stronger existing research base, 
will be more heavily into development, implementation, 
and evaluation . 



. . . labs will not look alike. They will all 
look like what they need to be in order to 
serve their regions most effectively. 



Some centers, like the Hopkins centers, will be what we 
call full service centers. We take the results of research all 
Uie way through development into inslilutionalizaiion in 
schools and disuicis because we want to get that bouom line, 
which is improved student learning. 

The regional laboratories should continue to assess the 
R&D needs of their regions and respond to those needs with 
R&D information and assistance. But the labs should also 
develop and maintain the capacity to conduct research 
projects and programs as needed in their regions. Lab re- 
searchers should be working hand in hand with innovative 
schools and disuicts. They should be helping to tailor exist- 
ing research to the innovative efforts of the schc'^'*^, imple- 
ment programmatic efforts, evaluate results, and provide 
needed further research as programs progress. 

There are questions now whether labs should be involved 
in research, whether thty should work directly with schools, 
whether they should be more entrepreneurial in their ap- 
proach to seeking funding from sources other than OERI. 1 
say the answers to these questions are simply yes, yes, and 
yes, all in the name of acquiring and maintaining the full 



capacity to meet the needs or the regions. Given this model, 
labs will not look alike. They will all look like what ihey 
need to be in order to serve their regions most erfcctivcly. 

The National Dif fusion Network, one or my Tavorites, is 
a system of State Tacilitators, funded developer 
demonstrators, and a program errectivenc^s panel to ccrtiry 
effective projects. The NDN offers a precise model for dis- 
semination and use of research-based R&D. And it is even 
a model with some evidence that it works in terms of im* 
proving student achievement. 

In an integrated system, the R&D centers and the 
regional labs would avail themselves fully of the NDN dis- 
semination capability by channeling their research-based 
school improvement products into the NDN as one major 
avenue of dissemination. This takes some work. The 
products and practices must be experimentally proved to be 
effective. But this is work that labs and centers should be 
doing as a matter of course. 

Right now only one regional laboratory, the defunct 
CEMREL, and one R&D center, which is the Hopkins 
Center, have put research -based pioducts into the National 
Di ffusion Network. This is a sad state of affairs. Centers and 
labs need to engage more in re>::arch and dev elopment that 
produces proven effective programs and practices for use 
by schools and districts, and they should move these 
programs and practices into the NDN. As part of this, in my 
opinion, the NDN is suiicturcd to improve schools by work- 
ing with schools to install R&D-bascd products, and there 
is no need to add the dissemination of research information 
to the NDN. Wc have ERIC to do that. 

And ERIC. I think one real need here is to let ERIC be 
ERIC, to let ERIC concentrate on its mission cf information 
dissemination and not dilute this cffoti with lists of addition- 
al tasks. ERIC*s primary purpose is to maintain a national 
repository of up-to-date education research information and 
provide that information in various forms to users. ERIC ac- 
complishes this purpose well. The ERIC clearinghouses can 
document that their services are used extensively, and labs 
and centers contribute to that accomplishment by providing 
the ERIC system with education information. 

But what else is expected? You can tell what the expec- 
tations are by the criticisms that ERIC gets. First, not enough 
people use ERIC, so the expectation is that ERIC must 
promote more use of the system. The second criticism is that 
the information is not always the best information. So the 
expectation is that ERIC must exercise better quality con- 
troL Third, the information is not in very useful fomis. So 
the expectation is that ERIC must do syntheses, analyses, 
and summaries that make the information more useful. 

These are all legitimate. Most clearinghouses are doing 
them to some extent, and much of what they are doing is in 
collaboration with labs and center.^. In the past 2 years the 
Hopkins center has produced two ERIC digests and tv o 
monographs especially for the ERIC Elementary Education 
Clearinghouse^ which is one of our partners and is a natural 
alliance. 



There is a founh criticism of ERIC that bothers me, and 
this is the criticism that ERIC infomiation is not well used 
to improve education. The expectation then is that ERIC 
must therefore not only maintain and provide education in- 
formation but also develop mechanisms and procedures to 
ensure effective use of the infonnation. The criticism that 
we are not making effective use of education infoi-nauon is 
justified in general but is notjusdfled as a criticism of ERIC. 
No other library system is held responsible for proper and 
effective use of its infcmiation, and ERIC should not be 
either. 

I need to belabor this, because I like to belabor. The ef* 
fective use of research information is a whole other ball 
game. I would contend that the use of research information 
from ERIC and from labs and centers has often conuibuted 
to school improvement. But if you ask me todocument that, 
I am going to run and hide somewhere. I would like to see 
somewhere in the near future an extensively funded effort — 
scratch the "eutensivcly"— just a funded effort to produce 
such documentation, to provide some evidence that dissemi- 
nation of research findings through ERIC, the labs, the 
centers has d;^fmitely contributed to school improvement. 



We need hard evidence that the dissemina* 
tion of research information has an impact 
on the school improvement bottom line: 
improved student learning. 



As an example, our center has extensively disseminated 
research about the effects of ability grouping in elementary 
schools. I make the claim that this research has been valu- 
able for schools and districts in organizing their insinjction. 
I have no evidence for this claim Other centers and the labs 
and ERIC have similar experiences. We need hard evidence 
that the dissemination of research information has an impact 
on the school improvement bottom line: improved student 
learning. Such evidence, when gathered, will sucngthen the 
entire R&D enterprise. 

I have left a lot of issues for discussion. I touched on an 
expanded role of centers and labs in working intensively 
with districts and schools. But what other sets of institution- 
al projects might be created to do that ki nd of work and what 
are the specific roles in this integrated system for the 
numerous education associations and organizations and 
special interest groups? There are a lot of other questions. 
A final question: Does all this require more funding, and 
where is that funding going to come from? 



David Crandall 



Director, Laboratory for Educational Improvement 

of the Northeast and Islands 
The Network, Andover, Massachusetts 

1 hope my remarks will provide the basis for conversa- 
tion among yourselves and among us later today and over 
the next year or so. This symposium is about one of the more 
important and perplexing and persistent problems that we 
face in the R&D world. 

I especially resonate to Bn]no*s noting that we do have 
a window of opportunity. I wish it weren't a window tliat 
was all that was left of the building we had constructed be- 
tween the late 1960s and the late 1970s, but I think the fact 
that there is at least a wi ndow left and that it is open is a very 
encouraging sign and I appreciate your acknowledging that. 
I am especially grateful to Sharon for the mviiation. She is 
smart enough to figure out how to get "ihrec-fers," which I 
am usually not. White, male, Anglo-Saxon Protesianis rare- 
ly get that kind of a check mark. But I am here as a lab direc- 
tor; I am here as the head of an organization that houses a 
NDN facilitator and did a developer demonstrator, and one 
of OERI's *'cenlcrettes," as we caJI them. 

And you have a special ueat. It will be interesting 
whether you see the differences. You have, in my simple 
formulation, one of the veteran centers, Johns Hopkins, one 
of the new centers, Susan's at Rutgers, and a representative 
of one of the little weensy centerettes that were sort of the 
leftovers when the big guys got carved up. So you have an 
array of people who come at the research end of this 
enterprise in different ways. 

I come at this having spent 20 years involved in en- 
deavors that have knowledge utilization in schools as their 
ultimate intention. When I started The Network in 1969 it 
was with the idea that the wondrous knowledge captured on 
those little tiny microfiche things should somehow get into 
the heads of school people and that an intermediary struc- 
ture was needed. 

That image has guided our work over the last 20 years as 
we have moved through successive engagements with 
Federal support at each level of enterprise, from the prac- 
tice improvement level, directly working in schools, the 
policy advice level, through research studies. 

We have been involved in the NDN since 1974. It won't 
come as any surprise to you that I am a fan of the NDN. My 
support and belief in thatendeavorwas reinforced asa result 
of a study that I directed in the late 1970s, which was the 
last major study of Federal strategies for improving educa* 
tion, and it demonstrated that indeed the NDN was a suc- 
cessful su-ategy. 

That it has persisted and flourished, albeit at the same 
level of funding as all of the rest of us, is, I think, a uibute 
to that. That ERIC has persisted, that the clearinghousesstill 
exist, that the regional labs exist* that the centers exist, it 
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seems to me, is a fact of life that it would be nice if some of 
our **friends" acknowledged and built upon as opposed to 
lamented and attempted to altero 

As thai window is held open by those of us who are op- 
timistic, I hope that we can row the boat with our oars going 
in the same direction for once. That may be something the 
new OERI leaders should ponder as ihey lake up new 
responsibilities. I can tell you more about what hap^oens 
when boats go around in circles. They tend to run into things 
and often sink. This one hasnH sunk yet. So there is ho|)e. 



[WJithout the intermediaries it is tough to 
move the information from the archive 
into action. 



We did the last major study of ERIC. Among its findings 
were that the people in the process were pretty important, 
that without the intermediaries it is tough to move the infor* 
mation from the archive into action. We disregard those 
kinds of things at our peril. I am not suggesting that you 
aren't aware of these things. I am just reinforcing them in 
the context of what will be my subsequent remarks. 

I have the additional good fortune of heading the regional 
lab that serves the area of Congressman Major Owens of 
Brooklyn. He is the gentleman who oversees OERI, our 
sponsor. So we are especially attentive to his perspectives. 
When he visited us with his staff a ye>v or so ago, after we 
had fjnished telling him what we were up to, what we were 
doing, what we werenU doing and why we couldn't do it — 
that's where we pitched the "we need more money" — he ac- 
tually initiated an intelligent discussion about ERIC. I was 
very encouraged by that. He also insisted before we left lo 
sec our "library/ I explained that we didn't havt a library; 
we had a resource center; and that it was a weensy one be- 
cause we didn't have any special funding for that But he 
was interested in looking at that and in looking at the resour- 
ces that we had that allowed us access to the ERIC resource, 
both paper and through our microcomputer hookups. 

That there is a fan and . supporter there is again no news 
to you. He's a fan of a lot of things, but let's put them under 
the umbrella of R&D, because I think he is one of our sup- 
porters. His special concerns for the children in our inner 
cities pose a special challenge to us. I am not so optimistic 
about that one, frankly, given the current level of funding, 
but I think we can make a substantial dent in that, especial- 
ly if we can make some inroads on the collaboration front. 

Turning to that brieny» let me share with you some no- 
tions that I think give us a handle on why we have a problem. 
Some of you have heard me say this before. Collaboration 
is not a nauiral act and the f^sitions that you nave to assume 
are not always comfoi table. Most of us are not i nto pain, and 
collaboration the wa/ that I mean it sometimes involves 
passing through the ])ain period before you can get to the 
pleasure. 

JO 
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But for people who have gotten there, I think we can say 
Iha^ it is worth it. We are talking about collaboraDon among 
institutional or organizauonal entities: labs, centers, the 
components of the National DifTusion Network, ERIC. 
Those entities have, as is no news to you, quite dirfcreni 
audiences that they emphasize and quite different agendas 
that they pursue as a consequence of their mission su;iiegy 
and preferred tactics. 

If you think about three notions, I think you will see 
where some of the problem comes from. Imagine a circle 
that has here "generality" and over here "simplicity" and 
down here somewhere "accuracy." Those are concepts to 
which I think it is fair to attach the activities of labs, centers, 
ei cetera. For example, the research endeavor, is focused on 
generality, typically. Those of us who work directly in 
schools know that what ^hcy want to know is how accurate 
it is for them, the single case: "Well, it doesn't fit our cir- 
cumstances; it's 100 abstract, it's too general." 

Those three concepts arrayed around a circle, it is sug- 
gested, constitute a condidon of impossibility: You cm'i get 
there from here. That is what we are trying to do when we 
tiy to bring research into practice. That formulation, set 
down by a Canadian named Thomgate lO-plus years ago. 
helps us understand why ihis is a persistent problem. It is 
very tough to move research into practice because the na- 
ture of it — research — is very different from the nature of 
it— practice. But as I said, I am an optimist. 

Here are the steps that I would suggest wc consider to 
continue to close the gap, as I think wc have. One, I think 
we need to declare a t>clicf in the special value of research 
and development and its outcomes. That's a value state- 
ment It is okay to make them sometimes. It is important that 
they be affirmed. And I don't think thai they have been. 

We are talking about a belief that I think we all share, at 
least in part, that the outcomes of our work arc qualitative* 
ly better th^n those that are pursued in a less sysiemaiic, less 
organized fashion. That is not to say that there aren't other 
kinds of knowledge that aie equally good; we're among 
those who are advocates of carefully developed practice- 
generated knowledge as well as conventional R&D 
knowledge. But that is a value statement. We have had 
tjoubiedemonsiraiing, as John noted, the bottom line payoff 
of thai It doesn't change the fact that we have to declare it 
as a value. 



School people donU want it easy, but 
they need it simple. That doesnU mean 
simplistic; it Just means simple. 



I thirik we need to acknowledge the continued need for 
some sort of a u^slation or development or repackaging 
function, whatever you want to call it, and the fact that the 
people out titerc who are the folks that we hope will even- 
tually use R&D need help. School people don*t want it easy , 



but they need it simple. That doesn't mean simplistic; it just 
means simple. We arc inundated on a daily basis with 
hundreds and hundreds of teachers who want to do better 
for the kids that they are concerned with. They do not know 
how and they are not in sellings that help them. We are part 
of the support structure that potentially could. 

So it seems to me that after we declare our beliefs in those 
kinds of things, including at the Federal level, we maybe 
could make the pitch that in the spirit of increasin{! our in- 
icmaiional competitiveness maybe we need to cha^.^j some 
of our national competitiveness practices. 

We have an infrastructure here. Every 5 years, 3 years > 
or whatever, if thecurrentcycle persists, weconsider break- 
ing it all down and building it over again. That's dumb, in 
my opinion. I think the elements that have stood the test of 
more than two decades — the clearinghouses, the regional 
laboratories, the State facilitators of the NDN, the parts that, 
it con be quite reasonably and persuasively argued, should 
be permanent parts of the infra:)tnicture as institutional en- 
tities — should be preserved in that fashion. 

Wc ought to find a way of cracking the nut on that part 
of our common enterprise. N\'hat they do, what they are 
focused on, and so forth and so on, is a different issue. But 
it is as if you arc going to tear up the roads, the bridges, and 
the sewers every 5 years and then ponder how to best move 
people and trash. It doesn't make any sense. ! think that it 
would be possible to crack that nut while still answering the 
call for necessary competition. 

Once we do that, then I think it is necessary to affirm and 
attack with adequate resources the persistent problems that 
face our c<iucational system. Separate from whether they are 
the ones you would agree on, the problems of the disad* 
vaniagcd,the underclass, the at*risk, etcetera, however you 
package that one, it seems like it is with us and is going to 
be with us for a while. That warrants special kinds of atten- 
tion. Whether it is by a super center of the sort J ohn referred 
to as a full service center, I dcn't know, but I would support 
that You could find fans for classifying science, math and 
technology in that category as well. I think a lot of people 
would say that's a place wi>ere we have a persistent nation- 
al problem. And it is going to last longer than 5 years, folks* 
and require more resources. 

I have already noted that once you have made some of 
these moves, you ought to be able to stabilize the practice 
improvement infrastructure, which for me at this point is the 
labs, the NDN facilitators, and the ERIC clearinghouses. 
Those institutions you don't move around unless they do 
something that is really ouD^geous in their performance, 
and there are a lot of ways to handle that one. 

Then we get to the collaboration part. So far this has been 
easy. Now you have to regularize exchange relationships 
between those entities that go beyond the superficial. Bmno 
noted his three Cs of communication, cooperation, and col- 
laboration. I would put those in a hierarchy and stick coor- 
dination in the middle right after cooperate. I think we need 
to understand when we are doing each of those things they 
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arc not (he same thing. Collaborating is not the same as 
cooperating; it's not the same as communicating. 

Those of you who have been around for a long while, 
there was a thing called the Dissemination Analysis Group, 
DAG. In the late 1970s it sponsor?^ two national forums. 
They brought together all of the players. It has been over 10 
years since there was such an effort One of the things that 
the DAG put together was a definition of dissemination that 
many of us seem to have forgotten. It moved from "spread" 
to "exchange" to "choice" to "implementation," implemen- 
tation is the last and the toughest stage; it's the most com- 
plicated and incorporates all the foregoing. The three or four 
Cs of communication to collaboration are the same sort of 
hierarchy. You need to understand what you are doing when 
yon are at each of those stages and that they relate but they 
are not the same. 

Paying attention to those distinctions and reinforcing 
those relationships is a special responsibility that I think it 
would^ possible and desirable for OERI or its successor 
to organize, to facilitate. They could reinforce that. There 
'wrcntly arc very few organizational incentives for the kind 
of exchange that goes beyond simply licking the stamp and 
sticking it on your latest report and firing it out in the mail. 
Yes, individuals rebte in different ways, but Jie organiza* 
tional entities don't. 



DAG put together. . . a definition of 
dissemination that many of us seem to 
have forgotten. It moved from spread^* 
to ^^exchange'^ to ^'choicc^^to ^Hmplemen- 
tation. " Implementation is the last and the 
toughest stage . . . 



Pm a fan of forcing that, by the way. I think that when 
people don't wain to do something, somedmes you have to 
help them to see that there is an optimal way. We have tried 
it once» and it hasn*t worked, but I think we should iry it 
ag^in. So OERI, I would advise, could play that faciliiaiing 
role. It is combining the forcing function with the friendly 
support in facilitation and avoiding the third F, fouling it up, 
which there is a terrible tendency » Tm afraid, for welNinten- 
tioned people n do. 

And if we c?n get our friends the Feds to stay out of the 
road for a while on some of these things, we will all be bet- 
ter off. V/e need time to get our own acts together, whether 
it be in networks or subnetworks of like-minded people or 
umbrella organizations. Yes, we know you, OERI staff, 
want to be involved. We want you to be involved, but ^or 
some of these moments we need our own time for our own 
processing. We need to be able to invite you, not have you 
invite yourself. At the same time, I think you ought to re- 
quire us to sit down and knock our heads together on some 
stuff and do that in some ways that haven't been tried ytl 



Then I would go back to what I ^id before and suggest 
that some of the communications that you might have that 
would be facilitating to our overall mission would be 
directed to the advisory boards, governing boards, and other 
of our oversight entities. We would be helped by messages 
from OERI that rei nforce the beliefs that I noted before, that 
R&D is special knowledge, that it is what these institutions 
are about, that it is what we are about togeilicr, but that it is 
a long-term problem. We are going to get on with it and not 
just be disu^tcd by the short-term stuff of today's hot topic. 
We need some help on that score. You guys can give it to 
us. And we can give it to each ouV.r. I look forward to being 
part of that process. 

Susan Fuhrman 



Director, Center for Policy Research in Education 
Eagleton InSiitute of Politics 
Rutgers University 

I appreciate the invitaiion and the opportunity to speak 
10 such a distinguished group. I especially like being able to 
follow John and David instead of preceding them, because 
now I can agree and disagree and not forge out ahead on my 
own. I also appreciate the background papers that were 
prepared for this meeting. I thought that the summary of the 
September working group was most accurate and very help- 
ful and ihe background paper specifically for this meeting 
was pa-'Licularly useful. 

I especially like the caveat not to think of collaboration 
for its own sake but to keep our eye focused on Bruno's bot» 
torn line, on John*s improving schools, on RD&D systems, 
on colbboraiion for the sake of improving the efficiency, 
the quality, the impact of educational research and develop- 
ment 

Of course it is not necessarily so that collaboration would 
have such an effect It may in fact take place for its own sake 
without an eye on the bottom line» and that is what it is real* 
ly important to be careful of. So I would like to talk for a 
few minutes about collaboration with that caveat in mind 
and then for a few minutes about improving the impact of 
RD&D, about the bottom line, about activities that may be 
achieved without thinking specifically about collaboration. 

I have four points about how to conduct collaboration in 
the service of improved RD&D, First, it occurs naturally, 
John's center, which has been in existence for 19 years, col- 
laborates. Our center collaborates. We conduct research 
with other centers; we involve researchers from centers and 
labs in meetings that we host; and we have cosponsored 
workshops with regional labs. 

It occurs when people perceive common inu^rcsts, when 
they know each other and really get to know each other in 
face-iO'face, personal interaction, and they think that they 
can ^ork together. It occurs among OERI-supported 
project : even when OERI is not footing the bill. We are 
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hopefully about to receive a grant from NSF with another 
OERI-fundcd center. So here is collaboiaiion occurring on 
its own and not because anybody is making us do it, but be- 
cause we thought we could work together in useful effort 

I disagree with David. I donH think that such collabora- 
tion needs or requires incentives &om OERI to take place. 
Fund seiasides and special competitions might in fact result 
in make-work collaborative projects and not necessarily in 
the kind of collaborative projects that keep their eye on the 
bottom line and that are in the service of improved RD&D. 

The same problem would occur with rewarding col- 
laboration per se. It is possible that the same resources could 
have been used better by an individual institutional project 
Collaboration in and of itself should not be rewarded or en- 
couraged. It's only collaboration in the service of improve- 
ment, and I am afraid that special competitions centered 
around collaboration rather than the goal of improvement 
however you get there, might send the wrong signal, 

I do think, however, that OERI can facilitate collabora- 
tion in a number of ways. It can certainly provide occasions 
for those of us in the system to get together and to get to 
know each other and to forge the kind of relationships that 
lead to working relationships. 



Collaboration in and of itself should not 
be rewarded or encouraged. IV s only 
collaboration in the service of 
improvement . . • 



It can increase its information-sharing activities and en- 
hance them. Our liaison calls us up frequently and says did 
you know such and such a center was doing X or Y, and 
maybe you ought to get in touch with so and so. I am sure 
that other liaisons do the same. We need more of that — the 
databases, the reports, the opportunities — to And out what 
we are all doing. 

And I think OERI can remove barriers where they exist 
to sharing data or to sharing work in progress because of 
confidentiality or whatever other problems might stand in 
the way. I think OERI needs to think about the comparative 
advantage of each type of institutional project much in the 
way that Jonn suggests and what each instiUitional project 
can best do. 

Speaking from the center's point of view, I agree with 
John that some of us consider ourselves full service centers. 
7e certainly do. We think of dissemination and technical 
assistance as pan of our mission. Not everyone does. But 
even so, our resources are not ample enough to permit the 
kind of extensive dissemination and technical assistance we 
would like to do and we would very much like to work wiLh 
others to do that more effectively. If there were ways to es- 
tablish routine mechanisms for other institutional projects 
to assist us in dissemination, to assist us in preparing briefs. 



and in disuibuting policy briefs, to assist us in disseminata 
ing our reports, we would certainly welcome it 

Specking- for our center, we would like to continue to 
publish our own reports, to maintain quality control over 
them. Wc would like to do our own face-to-face disscmina** 
tion. We believe there is no substitute for the people who do 
the research talking about it to the research clients, and it is 
very helpful to have contact with the field in dissemination 
and setting one's own research agenda and testing the 
general inability of Hndings. So we would not give that up 
at all. But we would certainly welcome assistance from any 
other ivpe of institutional project in synthesizing informa- 
lion and in distributing it more widely and fmding ways to 
magnify our impact and to share the resource that such 
spread requires. 

Turning to other ways to improve RD&D besides col- 
laboration among institutional projects, I think that OERI 
can facilitate oneof the kinds of collaboration thatJohn was 
talking about between OERI-funded projects and the field, 
and that is to work with associations who are among the 
most important purveyors of research information. 

We work closely with policymaker associations, and I 
know other centers work closely with practitioner associa- 
tions. We spend our own resources to convene these folks 
and to keep in close contact with them. It pays off. It pays 
off because it helps us to set our research agenda, to meet 
the needs of their constituents, the same constituents that we 
serve. It helps because they pick up and publish some of our 
things in brief reports or even in report form. And it helps 
because we end up sometimes in joint research projects just 
as we have with other centers when we know the people in- 
volved. For example, we are currently involved in a joint re- 
search project with the National Governors' Association 
and just completed one with them a brief while ago. 

I think OERI can encourage links with clients and 
clients' groups in mission statements and in continuing 
liaison work with centers. I think OERI can provide oppor- 
tunity for client groups to meet and hear center researchers, 
occasions for hearing and interacting with researchers from 
a variety of centers, and facilitate that kind of interaction 
which is really important to getting the research to the 
clients. 

Finally, I think OERI can work with other government 
agencies and collaborate itself to enhance RD&D. For cx- 
ample» working with NSF in the areas of math and science 
could certainly improve the resources and the integration of 
projects addressed to improving math and science educa- 
tion. 

I think it is important to reinforce the background paper's 
notion that collaboration for its own sake may not lead to 
improvement It may lead to well-intentioned but not par- 
ticulariy promising work and not the best use of resources, 
and ai the worst ii may lead to make-work just for the sake 
of collaboration. Focusing on collaboration among institu- 
tional projects may limit thinking about other ways to im- 
prove RD&Dt such as working with client-based 
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associations. Collaboration is important when it keeps its 
eye on the bouom line, and I think there arc a lot of ways to 
dolhaL 

Christopher Cross 

Vice Chairmani Macro Systems, Inc. 
Silver Springi Maryland 

I am going to depart a bit from commenting directly on 
the presentations we have heard this morning and raise what 
art, I believe, some other important issues to consider in 
today *s general topic and the general topic of education dis- 
scminalion and information. 

As Bruno mentioned, I spent some time on the Hill; I also 
worked on education policy with the Department of HEW 
in the early 1970s, before there was a Department of Educa- 
tion. For the past few years, having been outside of the 
government, I have tried to look from the viewpoint of the 
consumer and the user, at the enormous array and variety of 
ways in which the Federal Government tries to provide in- 
formation to people out in the field. For example, I think in 
terms of the school my son attends, and I wonder how the 
teachers and the staff members can possibly comprehend 
and deal with the complexity of the cuTcnt system. 

One of the things that we rcai.y must do is to look at this 
system from the viewpoint of that consumer and that user, 
recognizing there are other consumers and users as well. 
There are school board people, and adminisuators, and re- 
searchers, and policymakers in the Slates and in the Federal 
Government I iliink we need lo look at the system from their 
perspective. 

For example, I would advocate that the Department, 
through ERIC or OERI or some other manner, consider ac- 
tually asking some of these consumers to participate in a 
focus group. Although this may not be the right terminol- 
ogy, a: v.'culd \t a similar group where we could really try 
to understand from listening to these people what informa- 
tion they need, how they would go about trying to get it, and 
what barriers exist in the current system that prevent them 
from getting the information they need. I wonder whether 
we have made the system too con plex and have created a 
situation that i** detrimental to the essential goal which all 
of us have« and that is to try to improve the education 
enterprise. 

Bnino mentioned that I spent some of my time in the last 
2 years working with OERI, with PIP, first with Milt 
Goldberg and now with Nelson Smith, looking at what the 
regional educaUonal laboratories have been doing and will 
be doing in terms of the recom petition. One of the things 
that we did in our initial report, which was about a year and 
a half ago, and have repeated in this report, is to also look 
beyond OERI. The conference here this morning and the 
report that Bruno mentioned, which was done in prepara- 
tion for this conference really center upon OERL And that 



is understandable. That is where the people who are in- 
volved in this enterprise reside, both inside the Department 
and outside it. 

But if we look at Cie array and the variety of other things 
that exist that go beyond ERIC and NDN and the labs ^i\d 
the centers and all of those things that we have already talked 
about, we must also, I think, step back and include things 
like the Chapter I centers, the special education centers, the 
bilingual centers, the drug abuse centers, the vocational 
education research activities. Susan mentioned NSF. There 
is also the arts endowment, the humanities endowment, and 
other providers of information. 

If we are going to have collaboration, cooperation, and 
communication, we must step back and examine that whole 
array of things. It has been now almost 25 years since the 
Elementary and Secondary Education Act was first passed. 
That Act and the Cooperative Research Act created the 
original labs and centers; and then Title I was created. In 
that period, particularly from the mid-1960s to the early 
1970s (with a little bit thrown in by the most recent Con- 
gress) a variety of other providers and other institutions have 
been created in the research, development, and dissemina- 
tion world. 



rr]he time has come ...to step back and 
look at the whole varied enterprise of 
research, development, and dissemination 
and to ask the question: What needs to be 

done now? 



I hope I am not giving away too much of what the 
Laboratory Review Panel has said in its report. Although 
the idea did not originate with us, one of the things we are 
advocating and that I personally feel very strongly about is 
that the time has come for the Department, for the Federal 
Government, and for the profession to step back and look at 
the whole varied enterprise of research, development, and 
dissemination and to ask the question: What needs to be 
done now? 

In the mid-1960s, when these original institutions were 
created, most of these groups were new; there was nothing 
else in existence. We now have a wide vaiiety of other or- 
ganisations, of other providers, of other needs that are in the 
system. As wc go into the 1990s and into the 21st century, I 
think ii may be time to call for something like a National 
Academy of Sciences/National Research Council panel to 
look at this enterprise and to think it through and come back 
10 the Department, and to the Federal Government as a 
whole, with some recommendations for organizing the 
RD&D system. The old answers may not be sufficient any 
more, and in fact wc may need to really examine some of 
our assumptions about why and how the current situation 
has come to be. 
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I also think we need lo examine ihc fact that there are dir- 
fcrcnt users, different consumers out there. One or the things 
that m^iy have happened over the years is that we may have 
designed a system that is appropriate Tor sophisticated users, 
users that tend to be more like us, people who are in the re- 
search community and the policy community, and we may 
have forgotten that there are many people out there who 
simply need basic information. They may need to know 
from Emerson and the Center siarf some basic statistics and 
data about what exists in the way orteacher preparation, en* 
roUment, what is bemg spent, and what the projections arc 
in terms of forthcoming enrollment and the birth rafe and 
thai sort of thing. There is probably another level of users 
or consumers who are a liule more sophisticated, and final- 
ly there are the most sophisticated users, the people that we 
probably deal with most often. 

Because different computers are suitable for different 
users, your children, if they arc in elementary school, may 
be using an Apple II or something of that sort. As parents, 
you may be involved in a more sophisticated system; you 
may use or have access to an IBM mainframe computer. In 
the same vein, we need to consider how to design different 
levels of getting into the information system- 

I would also suggest that from the viewpoint of the 
Department we need to build in dissemination and com- 
munications as a fundamental part of all the research grants 
that are given out, of all the contracts that are awarded, and 
that there needs to be then some way to make use of that in- 
formation and data. It is just not good enough to say at the 
end of the contract or the end of the grant that you have to 
turn over your data and it has to be in machine readable form 
and all that; the point is, what are we going to do with it? 
Some things need to be thought through about how the 
Department is going to respond to its stewardship of that 
kind of information and data, how it is going to make it avail- 
able, and what does that responsibility mean. 

My flnal point is that I think we also need to recognize 
the fact that the procurement mechanisms that have existed 
even longer than ''*e labs, the centers, and the ERIC system 
may not really : • appropriate for the kind of relationship 
that needs to txisi between the Federal Government and in- 
stitutions like y*'>ur own. The constraints that are there in 
contracts, the lack of accountability that may be there in the 
grant mechanism, the protections that arc there in the con- 
tracts with the providers, the unilateral nature of a grant — 
all of these things really beg the issue about the unique kind 
of relationship that exists between the Federal Government 
and institutions tliai are providing the kind of services we 
have talked about here today. 

That is certainly something that can't be solved by this 
group, but it can be solved if the Congress becomes an ad- 
vocate and the Executive Branch begins looking for new 
niechanisms to do the job. I think that is another point which 
I believe needs to be looked at in tenns of the long view. 

As you can see, I haven't talked very much about the 
Q oUiersand their presentations this morning. I don* t disagree; 
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with any of them; I think the points they have made are very 
good. I would like to thank those who provided the materials 
for today's sessioni Sharon and her staff and others. I hope 
it has been helpful. I certainly found it very informative. 

Willis D, Hawley 

Dean, Peabody College 
Vanderbilt University 

It is a pleasure to be here- 1 am going w try to do two 
things. I want to share with you some general principles or 
some bases for collaboration. Secondly, I want to comment 
on the nature of the research and development system wc 
have been talking about 

Hopefully these two sets of comments will overlap with 
what the previous speakers have said. This is what is called 
in the trade a dump, which is to say I am going to put a lot 
of information on the table, but we are all used to that. 

I want to suggest five or six principles and give you some 
examples how each of those principles might apply to the 
development of productive collaboration. Presumably, if 
these arc really principles, they are heuristic and therefore 
would lead to many more ideas. That is for you to judge. 

What arc the bases for collaboration? Number one, com- 
mon inicrest. We have talked a lot here today about 
priorities. One might expect this common interest to be stu- 
dent learning. But in fact, if you listen carefully, those com* 
meniing today didn't say student learning. They said school 
improvc^ncnt or the equivalent My judgment is there is a 
big difference between student learning and school im- 
provement And if you don*t believe that, think about the 
debate today about restructuring. Very little of it has to do 
will direct concern for student learning, although the as- 
sumption is that restructuring will somehow benefit stu* 
dents. 

I don't want to get off into that set of issues, but I think 
we need to be precise and we need to know what we are talk- 
ing about when we say learning. If everybody, in fact, had 
this se; of concerns and saw a need to justify restructuring 
by its conuibulions to student learning, we would be better 
off. 

Related to that is the idea that researchers often don^t see 
a relationship between their role as researchers and the 
utilization of knowledge in the field. That is to say, re- 
searchers usually say, and I think most of us believe, that we 
are in this \o enhance student performance. But the model 
we have in our heads is a linear one; that is, the knowledge 
that is generated is ''disseminated** and lands out there some- 
where and somebody does something with it Meanwhile, 
we go on about our business. 

But there is another model , a model which we see in some 
other fields — medicine is a good example — in which the im- 
plementation process itself is part of the generation of new 
knowledge and the generation of a set of research questions 
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(hat need to be developed. In my particular insiitulion we 
happen to have a basic research enterprise heavily Tundcd 
by the Federal Government, though not this Depanmeni or 
Education, thank God! (Not because I don*t love this agen* 
cy, but because the NIH has a lot more money.) In medicine, 
the relationship between research and practice is seen as 
reciprocal and this provides the rationale Tor collaboration. 

The second basis for collaboration is trusL The actors 
have to trust one another. Part or this has to do with the per- 
ception (hat everybody is engaged in quality activity. We 
v^iU say we are. But, in fact, there is a lot or low quality ac* 
Uvity that passes for research and development. 

There is too much research already; 
there is too little good research. 



The ERIC system, in placing emphasis on the volume of 
work that is done, diminishes the quality of work that is 
done. You know very well that when you rccompcie these 
enterprises, the volume of activity will be weighted heavi- 
ly. There is too much research already; there is too iiuJe 
good research. But it is hard for practitioners to separate the 
weak from the good, given the time they have to consider 
the information. Our unwillingness to be more selective and 
critical undermines knowledge utilization because it under- 
mines the faith one can have in the research. 

Another principle of collaboration is that perception of 
mutual benefit is essential. Part of this will derive from a 
shared concern about outcomes, but it also depends on what 
our mission is perceived to be. Why, for exaJTiple, should 
the centers and labs collaborate? There is involved here, too, 
something that is called the nomi of reciprocity thai is im- 
portant. That simply means that collaboration occurs when 
there is the perception of equal conuibutions to a collabora- 
tive activity. 

In the world of academia, tliere is a hierarchy of the 
values placed on different aspects of knowledge production 
and use» as you well know. At least among some people in 
the research community, research itself is the highest value. 
Dissemination is usually not highly regarded. It is a neces- 
sary thing we've got to do, but it is not high tech; it*s not 
really good stuff: itdoesn*trequire the same quality of mind; 
it doesn't need tenure, et cetera. 

Part of the problem, I think, is we have not thought 
through how we could create kind of interdependencies that 
would lead to equal status. In my judgment, I think it is im- 
portant for the labs to have a role in the research enterprise 
because absent that role they will be seen as second class 
citizens vis-a-vis the research community. None of us will 
say that in public, but we, in fact, perceive it. In talking to 
some of my friends in the labs, I think they perceive that 
their limited research activity has undermined their status. 

A fourth general proposition about collaboration is the 
fieed for a common language. For example, the word '*rc- 



i'carch'' is a badly abused notion; "learning" is something 
I lat means almost everything; and "knowledge utilization** 
Itself is, at least, a sloppy term. 

It seems to me there are, at least, three very important 
distinctions to made. One is the effort by practitioners 
and policymaker^ and other researchers to use the informa- 
tion. The second is the adoption of that information. The 
third and most important, probably, is implementation. But 
we can't hold the knowledge production process itself ac- 
countable for implementation except insofar as its role is to 
study implementation. On the other hand, we can hold the 
process accountable for cfTorts on the part of practitioners 
tc utilize that information. 

A fifth basis for collaboration is what I might call com- 
mon consuucts. I have had the opportunity lately to read a 
lot of research or why people use knowledge. I have come 
to be impressed by a body of research, relatively new, I 
think, which explains this in terms of '*exp!anation-based 
decision m^ing." That is, people have in their heads an ex- 
planation for how the world works. When information they 
are provided with fits that explanation, they use it to 
elaborate their worid view. If it docs not, they dismiss that 
information or modify it. Sometimes, this willingness to use 
information is explained in terms of ''value fit." But morc 
than values is involved. It is also their understanding of what 
works. So it would be very helpful if we started talking in 
terms of some kind of causal understanding of sources of 
student learnings. 

Incidentally, I reviewed many of the models that were in 
the proposals that went to OERI during the Center competi- 
tions last time. They have a different conception of the fun- 
damental processes by which children learn. This 
conceptual confusion is an important barrier to our ability 
to ccTimunicate and build a solid research base upon which 
to rest changes in policy and practice. 

From my point of view, the wav this particular group 
should be thinking building models is in terms of how 
policymakers and practitioners think. They grasp for certain 
kinds of explanations, because those are things with which 
they can deal. For example, policymakers and practitioners 
are not interested in social class per sc. They can't manipu- 
late social class. 

We should think about ways to enhance 
the self-interest that individuals have in 
collaborating. 

The final basis for collaboration is self-interest. We 
should think about ways to enhai^ce the self-interest that in- 
dividuals have in collaborating. Collaboration is aiot a 
natural act for most people. It may be for some of you be- 
cause you are so commiued to it. But, in fact, collaboration 
is a costly activity. 
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Let me make a few comments on the Federal R&D sys* 
tern. I owe some of these ihcughts, let me acknowledge, to 
Aft Shcckey, who has been my tutor for more years than I 
want to remember. Let me make again Ave or six quick 
points. There are important missing pieces to the system it- 
self. One of these relates to how we conceptualize the sys- 
tem. So my first point has to do with the missing piece of 
the system, which is to see the knowledge utilization pan 
feeding back to the research part There are ways to do that. 

But a mo\t important thing I want lo emphasize is that 
there are three reasons, it seems to mc, why people who are 
practitione/s really want information. One is that they arc 
very confident and they have had somt success experiences 
in the past using information. This type of person becomes 
an information junkie and they see that as pan of their own 
self -interest. They like to talk about culling edge acuvity, 
and, to be cutting edge, it is helpful to know the latest re- 
seirch and a few concepts to throw around. 

Another knowledge-user is the person who is desperate. 
For this user» any information will do. It doesn't matter 
whether it is good or not so long as the information kind of 
fits the immediate need of the potential user. The third 
reason people use information is that this is their role. Those 
whose job it is to acquire information and to use it are rela* 
lively few in number. If you think about school systems, for 
example, who is it in a school system whose job it is to uti- 
lize research, especially at the school level?. 

This limitation on the use of knowledge is important and 
it could be addressed by changing the role of librarians. 
Their job has been to provide learning resources for stu- 
' dents. But, why couldn't they also provide information to 
teachers to help teachers teach and to help school ad- 
ministrators facilitate the work of teachers? It is interesting 
to note that the American Library Association has endorsed 
this general^ idea, but having Uned to implement such a 
program in my own university to prepare libraries accord- 
ingly, I can lell you the worid is not yet ready for iL 

A second thing we should do to strengthen the R&D sys- 
tem is to rethink teacher and administrator gaining, because 
those programs are increasingly organized around the idea 
of enhancing the craftsmanship of people in the field. They 
are big on internships, practical experience, and above all, 
relevance. The point is that there is liulc emphasis in these 
programs on knowledge utilization and problem solving. 
Until we attend to the predispositions and capacity of prac- 
titioners and policymakers to be information users, we will 
not have a market among the most imponant of our con- 
sumers. 

Let me use the repon that you all have to make the last 
point The repon shows the organization without showing 
schools and policymakers. The point I want to make is that 
when we think atx)ut the Federal R&D system, we should 
think about its cl ients as pan of the organization, an idea that 
. Chester Barnard tried to impress upon organizational 
theorists in business schools some 50 years ago. 




The third point is that the Federal R&D system needs to 
accommodate to the new role and capacity of the States. I 
know that is an issue that you folks have thought about 
some, but it has big implicaUons not only for the role of the 
labs, but also the role of the ERIC system. We need b.) think 
about and anticipate radical restructuring of the entire R&D 
system. Some of us have advocated the establishment of a 
National Institute for Urban Education. I had an opportunity 
to talk with the Under Secretary about this last nighL There 
is a lot of group interest in this proposal. 



We need to think about and anticipate 
radical restructuring of the entire R&D 
system. 



Some of us see this as a stalking horse for a reconccp- 
tualization of the entire system. I certainly think we are not 
ready lo move toward the National Institutes of Education, 
but such a proposal docs try to accommodate to the need to 
better integrate the elements of the R&D system, including 
ERIC, so that the system can be more helpful in addressing 
significant problems. 

Finally, let me suggest that the ERIC system nce^s to be 
realigned. I think aoout this in two ways. It can eiihericalign 
with the producers or wiJi the consumers, but you have to 
be on one side or the other, it seems to me. One way to do 
this is to either consolidate or cluster the existing ERIC 
centers. The second is to Lh nk about aligning the ERIC sys- 
tem with the priorities whic!»are manifest in the missions ol 
the research centers. 

Those arc two sets of ideas. Hopefully, they will provoke 
further thought. Thank you for the opportunity to be here. 

Milton Goldberg 

Director, OfTice of Research 

OfTice of Educational Research and Improvement 

VS. Department of Education 

I am going to make some comments about what I heard 
without necessarily referring to the speciHc individual who 
made the comment. 

First, I was suuck by the mention of the number of 
programs across the government that are not attended to in 
the papers that were discussed here, nor were those 
programs mentioned very much in the presentations. 

I must say that as a government bureaucrat I myself was 
smjck by the notion that ^ e have a lot nerve aski ng others 
to collaborate when you consider how Inadequately we do 
it ourselves. But that doesn't stop us, nor should it, I think. 
I think we should continue asking and pressing ourselves to 
consider better ways to work together with others who have 
mutual concerns. 
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The issue of ihc boiiom line came up more than once. Ii 
struck me thai thai is noian unimponani matter. I would like 
to make a suggestion. You can't make student learning the 
bottom line, because every time we \xizi over the years with 
the institutions with which I have had some association, 
whoever they are, it has always been pointed out to us that 
there are so many other variables that you can't really do 
that; you can*t really hold the institution accountable. 

What I would suggest is that the bottonr« line has to be 
through some agreement we reach on what we agree an in- 
stitution can be held accountable for. In other words, who 
are the consumers that you are attempting to help, and what 
are the ways you propose assisting them, and how will you 
be held accountable for the quality and nature of tJie service. 
I think there is not adequate agreement about bottom line 
across all the institutions that we presently support 

On the issue of the cost of collaboration, I would like to 
suggest that I do believe that collaboration is costly. I also 
believe, however, that some of the best examples we have 
of collaboration that I am aware of have occurred naturally. 
So I agree with Susan in that regard. 

I would like to suggest that one of the things we ought to 
do is perhaps identify some of t^iese examples of collabora- 
tion that have occurred and try to Icam more internally. 
After all, we are an R&D organization. Pzrhaps we our- 
selves ought to study a little more about how these things 
have worked, what has made them work, and perhaps do 
some documentation of these collaborations that might be 
made available to all of us. 



prjhe clients of the work that OERI 
supper need to have afar more important 
role in the formation^ the implementation^ 
and the evaluation of the work we support. 



On the issue of di^^semi nation, Chris' notion about dis- 
semination being part of all grants. I couldn't agree more. I 
don't think that necessarily means that every organization 
and every grant needs to accomplish exactly the same 
things, but every organization that gets an award from 
OERI, it strikes me, needs to consider how tlie consumers 
who are supposed to bcncfu from this piece of wurk will 
either get the information or will be helped to get the infor- 
mation that this particular award will make available. 

I also believe, however, that the institutions that are rep- 
resented in this room do have primary functions and that 
they need to play out those functions. But at the same time, 
each of the institutions may end up doing some of the things 
that other institutions do. That is true across the board. I 
would hate to believe that anybody ends up saying, for ex- 
ample, that research centers don't help practitioners, be- 
cause I don't believe that to be the case. 
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Finally, the issue of the clients and our attention to 
clients. I believe we have a long way to go in that regard, 
but I couldn't agree more that the clients of the work that 
OERI supports need to have a far more important role in the 
formation, the implementation, and the evaluation of the 
work we support. 

Nelson Smith 



Director, Programs for the Improvement of Practice 
Omce of Educational Research and Improvement 
U.S, Department of Education 

In listening to the members of the panel, it occurs to me 
that there are within the existing system a few rclativcly 
simple steps that can be taken. One of these was mentioned 
by Chris when he talked al'x)ut building dissemination into 
all of our programs. We are currently trying to do something 
along these lines with one of our new programs. We are 
uying to conform the specs for the applications to the exist- 
ing specifications for the Program Effectiveness Panel of the 
NDN so that when projects come in we will be relatively 
sure that the winning projects are going to be in the kind of 
shape in terms of their evaluation data that we car get them 
fairiy quickly into the NDN. We have this apparatus set up. 
We ought to be able to use it by conforming things in that 
way. 

It was mentioned by one of rhc panelists that we should 
be able to provide doc umentatioa of the effectiveness of our 
programs. I agree wholeheancdly. We have uied to do that 
in the last few years and we have tried specifically to do that 
in fact with reference to an evaluation of the labs. It has been 
difficult As things have happene<1, our funding for that has 
gone to other purposes. There are certain things that we 
don't have control over, but that is one of the things that I 
would like lo see happen, much more specific evaluation, 
not just of whether the entities that we fund across the board 
are doing what we ask them to do, but whether they have an 
impact out in the school systems. 

As Susan Fuhrman said, collaboration is not an end in it- 
self. I would like to turn for a moment the whole emphasis 
here away from what we are doing at this level, looking 
down toward the consumer and what the consumer needs, 
looking up towards what we are doing here. Or maybe the 
ups and downs should be reversed in that formula. 



y/hcn do you collaborate? You collaborate 
when you need to get something done and 
you canU do it by yourself 



When do you r jllaborate? You collaborate when you 
need to get somcoiing done and you can't do it by yourself. 
Our mission, a seems to me, is to stimulate innovation and 



improvcmcniai ihc school level. I ihink we ought lo be loDk- 
tng at how the consumers ought to be able to collaborate 
with each other using the devices and the services that we 
put out 

If I could qu ote from— I don ' t know whether to call them 
educators of the 20th century or prominent politicians- 
Barry Goldwater and Chairman Mao. You rarely see them 
together at the same time. Mao Zedong said, Let a thousand 
flowers bloom. There is nothing intrinsically wrong with 
having a lot of different approaches out there to the solution 
of aproblem. If I can paraphrase Barry Goldwater, competi- 
tion and pursuit of innovation is no vice and collaboration 
in pursuit of confused goals is no virtue. 

Great ideas spread because people need them, whether 
the idea is freedom or whether the idea is tabletop fusion. 
Around the world right now people know that we need ener- 
gy, and so there is tremendous competition to fulfill that 
need in whatever way possible. 

The fulfillment creates a marketplace. My qualm about 
our discussion today is that we are dealing with the 
marketplace as we have established it As Chris pointed out, 
when much of the current system was established in I96S, 
the world was a very different place. There si.Tjnly was not 
the market in educational products and services that there is 
today with the $330 billion that are spent across the country 
each year. Yet we operate from what economists call a 
market failure model as if there were no real markeu as if 
we could decide what needs to be done and then somehow 
press that down into the school systems. 

Maybe there is a need for a two-tier approach, because 
there are places where the market docs fail. During our over* 
sight hearings acouple of months ago, Congressman Stokes, 
holding up our publication Becoming a Nation of Readers: 
Implications for Parents, asked, ''What do you do when you 
have a parent who can't read? How are you going to get that 
parent to participate in leaching the kids to read?** 

Well, that is a place in which we have research. We know 
how to act and we have to, in fact, be very aggressive in 
moving that research downward. But for much of the rest of 
the country there are consumers who want to do the right 
thing and who want to participate to the extent possible in 
using research if they understand its importance and if they 
have access to it. 

So instead of making sure that we disseminate from the 
top down, I would like us to realize that there is no great 
automatic system possible. We will never get to the place 
where everybody has exactly one function and it is all com- 
puu^rized and we can push a button and the exact combina- 
tion of right products will land on the doorstep of the school. 

I think part of this process is to fmd ways of empower- 
ing the consumer, the parent, the teacher, the school prin- 
cipal who has little control over textbooks and things of that 
sort and to get them creatively into the process so that they 
can make choices through the NDN, through the labs, 
through the centers on what they feel is necessary for their 
own work. 



Emerson Elliot 



Acting Commissioner 

National Center for Education Stati^itics 

Orrice of Educational Research and Improvement 

UJS. Departmei t of Education 

Sharon asked me to talk about what I might like to see in 
ERIC, so these may supplement or complement some of the 
other things you have heard about. 

One of the things I frequently tell my staff members is 
that I expect them to keep up with research literature and to 
knc-v what research is saying, because I think the only way 
that they can design sensible data collectioh systems is to 
know what already has been 4one and to make use of the 
measures that we have learned about in research. We don*t 
do that very well, actually. I would like to state what seems 
to me a parallel oiith, and that is that I think ERIC should 
keep up with what NCES is doing and I don*t think you do 
that as well as you should, or certainly not as well as you 
could. 

So what do I want of ERIC? The fu^t thing is that I think 
ERIC should regularly include within its data and retrieval 
systems information about NCES data, where to fmd it, 
what is in ii Wc have a lot that is coming. I have no idea 
right now — no doubt you can tell me in the hall on the way 
out — what information you have about such things as our 
school and staffmg suidy that is going to be producing a 
major beginning of a continuing data collection with infor- 
mation about schools as places and about teaching and about 
teachers as individuals. 

About the National Assessment of Educational Progress. 
That is very hard to use. Larry Rudner knows all about how 
to use it, and he can tell you if you ask him. That is going to 
be done on a Siaic-by-Staic basis beginning in 1990. 1 don't 
know how many people are familiar with that, but that is 
one thing that I hope will soon be in the ERIC system. 

The study of college faculty is coming out this year the 
student financial aid study is already out. Longitudinal 
studies produce information all the time. Hike to assert that 
the data that the Center is now producing is far more useful 
for analytic purposes than it has been prcvioa^^ly. It is more 
useful in pan because it is more comparable. We are making 
a major effort with States and other data providers to make 
sure that the data are more comparable to begin with. 

It is also more usable for analytic purposes because the 
databases are larger and subdivisions can be made that have 
various kinds of represenuitive qualities: public schools, as 
always, but also private schools: States as well as national 
totals and regional totals; divisions by cities, suburbs, rural 
areas, and other qualities. 

I think those kinds of things about our data should be a 
part of the ERIC system. But that is not enough. I think that 
ultimately we should woric in the direction of actually 
having data in the ERIC system. 
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t would begin with whai is easy. The tables from ihe 
Digest ought to be a part or the system. Or tables Trom any 
of our reports should be accessible in the system* but ul- 
tiniately I think that in some electronic means it should be 
possible for analysis to retrieve data directly. That remains 
a major challenge. We have daia users all the time now ask- 
ing us for floppy disks instead of tapes, and I think jncreas- 
ingly people will be asking for CD-ROM. Since those are 
the people who are analyzing the data, somehow we have to 
And a way to produce it in a fomn that they use. 



[CJollaboration best comes about where 
the missions intersect^ where there is 
something to be done jointly that both 
people want to do because it series both of 
their purposes. 



Welljohn said let ERIC be ERIC I think we need to talk 
a minute about letting the Center be the Center. One way to 
think about collaboration is that it begins with a mission. I 
think every agency must have a very clear sense of its own 
mission, which is why I support the particular configuration 
that wv have of OERI, b<xause I think each part of OERI 
has a very strong mission. I think the collaboration best 
comes about where the missions intersect, where there is 
something to be done jointly that both people want to do be- 
cause it serves both of their purposes. 

One thing I frequently think about is what is the unique 
mission of NCESt because it seems that everybody gathers 
data of some kind and everybody does analyses. So what is 
it that wedo uniquely? One of the things that statistical agen- 
cies in the Federal Government do uniquely is standardize 
and define things. You have to watch out, because some- 
times the wrong things get defined and those are the 
measures people follow. That is a challenge for us. Stand- 
ardization and uniformity is one of the major things that 
statistical agencies are all about. 

Another is the collection of large-scale data sets that have 
goodt usable properties. Then we report things, and we put 
outdata tapes. But we do very little analysis. Our reports are 
frequendy dull almost by design, because the integrity of 
our data would be questioned if people thought that we were 
engaging in policy advocacy or program evaluation or 
causal modeling. So those are things that we eschew in our 
reports. 

But that means if our data are to see the light of day that 
they need to find their way into the hands of analysts. That 
means the Office of Research and PIP, and the grantees and 
conuactors of ihose organizations, and universities and 
State legislatures and governor's offices, and all the people 
« who do analytic work, certainly including the ERIC centers 
as welK must have and use our data or no one will ever know 
about iL 

erJc 



Finally, the last thing that I would like to ask of ERIC is 
your advice. One reason that I want to encourage ERIC 
centers to make use of our data is to lest out my assertion 
that our data are better. If they arc better, then your reports 
will be better and the public will be able to realize the enor- 
mous amounts of money that it is putting into NCES. 

But we will get something else out of that. In the course 
of using them you will learn about their attributes, about 
their shortcomings, and I hope you even learn about some 
of their advantages. But you will learn about their shortcom- 
ings, and I hope that you will let us know. That is the final 
thing that you need to give to us, your knowledge and ex- 
perience from using those databases so that we can make 
them still better. 

Ray Fry 

Senior Advisor, Library Programs 

Office of Educational Research and Improvement 

US* Department of Education 

In listening to the many interesting presentations this [ 
morning, one of the things that came to me is that there may 
be a sleeper institution out there in the educational spectrum 
that you could be overiooking, and that is the public library. 
If lifelong learning is really critical in today's society, if 
early childhood education is that important, if parental in- 
volvement is a good thing, the public library, the cradle-to- 
thc-grave institution, is there and no one is denied 
admittance. Anyone can have a card. 

It is in the area of dissemination that 1 think the public 
library could play a greater role. We have had a program 
called Inter-Library Cooperation that has been going since 
the mid-1960s under the Library Services andConsu^clion 
AcL This is a program through the State library agencies to 
build networks of libraries of all types, to tie the school 
library into the public library, to the academic libraries, to 
the special libraries. 

When Dr. Hawley mentioned the school librarian play- 
ing a greater role in resources and research and dissemina- 
tion, that is very true. School libraries, particularly in the last 
8 or 10 years, are coming into these networks. In the late 
1960s and 1970s, it was mostly networks of public libraries 
with academic libraries coming in somewhat, but now 
school libraries more and more are coming into these net- 
works. Right here in the District of Columbia several of the 
large high schools are tied in by computer to 'Jie Martin 
Luther King main public library to tap resources. 

Many of you as you have moved around the counU7, as 
most of us have, know there are a lot of weak public libraries 
out there, and we really don't have a good fix on the status 
of public libraries. But thanks to Emerson and NCES, the 
first attempt at getting good statistics on public libraries is 
under way, and I would say within 2 or 3 years we will have 
a good statistical system on public libraries. 
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I have been working on an accrtdiiaiion errotl for public 
libraries for about 3 years. I can*i say ihai things look that 
rosy in the accreditation area. We do have, though, a r.v>w 
program called the Public Library Dcvelopm^r^ Program 
where each community comes up with ar assessment and a 
plan Tor its own public library* 

One other comment in closir^. Not only under Title III 
are we funding projects, abo jt S20 rnillion a year, through 
the Slates to build these networks, but under Title I of the 
Library Services and Construction Act we are funding about 
3,500 projects a year to improve services for citizens of all 
ages, many going to eaily childhood education, of course* 
You might be interested to know that Major Owens, who is 
a librarian, administered one of these LSCA projects before 
he became a Congressman. We think that is one of the ways 
he became so well known in his community. 

Bruno V. Manno 



Acting Assistant Secretary 

Office of Educational Research and Improvement 

VS. Department of Education 

T-Ct me conclude by saying that I siancd the program by 
using a well*wom phrase. Just because it is a well-worn 
phrase, I think in a lot of respects il points to the important 
truth. The important truih is that wc do in fact have in a cer* 
tain respect a window of opportunity. It is brought on by the 
confluence of a number of different things. Many of these 
things were referred to over the course of our conversation. 

Strictly looking at this issue from an OERI perspective, 
we have the awarding of the ACCESS ERIC contract, which 
is the first new addition to ERIC in a number of years. In 
addition to that, we have the lab and center competition 
coming up. Actually we are in the process of staging that 
compciiiion right now. Wc have just received the lab report 
from Chris* group. Milt Goldberg and his staff are just about 
ready to begin opportunities for public comment on the cen- 
ter part of this competition in which, I am sure, you folks 
should be involved. 
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In addition to that, there is this general son of trend that 
I referred to early on in my comments, the trend that points 
0 the need for RD&D. It is not just the cducaUon com* 
lunity talking; it is the wider community of policymakers, 
of what I might call lay people, of the business community, 
of other citizens saying that if there is any one role that the 
Federal Government has when it comes to education, it is 
the provision of accurate, reliable, timely information on 
education. 



[I]f there is any one role that the Federal 
Government has when it comes to 
education^ it is the provision of accurate, 
reliable, and timely information . . . 



All of this, I think, points to that so-called window of op- 
portunity with or without a house around iL We would like 
to hope that over the course of the next few years we have 
the opportunity, if you think the house has been totally torn 
down, to begin to rebuild the house. Of if you are of the 
opinion that the house is in need cf some renovation, that 
we have the opportunity to restore and renew the house. 

Sharon Horn 



Acting Director, Information Services 

Office of Educational Research and Improvement 

U.S. Department of Education 

Where do we go from here? If you are on our list, you 
will receive papers and proceedings from this meeting. We 
also would like to ask each of you who has an interest to 
submit in writing to us, whether in bulleted form or through 
some form of a paper, exactly what you think about this 
RD&D issue and also how this collaborative piece fits 
within the documentation of what we are going to U7 to do 
within OERL The window is open. V/e have begun. 



